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Summary 

Pilot opinion and performance parameters de- 
rived from a six-degree-of-freedom ground-based 
simulator (the Langley Visual/Motion Simulator 
(VMS)) and a six-degree-of-freedom in-flight simu- 
lator (the USAF-AFWAL Total In-Flight Simulator 
(TIFS)) are compared for a jet-transport airplane 
having conventional cockpit controllers and instru- 
ment displays with 31 different longitudinal dynamic 
response characteristics. The primary pilot tasks 
were the approach and landing tasks with emphasis 
on the landing-flare task. The primary objective of 
this paper is to provide information to the flight con- 
trols/flying qualities engineer that will assist him in 
determining the incremental flying qualities and/or 
pilot performance differences that may be expected 
between results obtained via ground-based simula- 
tion (and, in particular, via the Langley VMS) and 
flight tests. 

The results indicate that, in general, flying quali- 
ties results obtained from the ground-based simulator 
may be considered conservative — especially when the 
pilot task requires tight pilot control as during the 
landing flare. That is, in general, the Cooper-Harper 
ratings (CHRs) and the pilot-induced-oscillation 
(PIO) classification ratings were higher (worse) on 
the ground-based simulator. The one exception to 
this, according to the present study, was that the pi- 
lots were more tolerant of large time delays in the air- 
plane response on the ground-based simulator. The 
results also indicated that the ground-based simula- 
tor (particularly the Langley VMS) is not adequate 
for assessing pilot/ vehicle performance capabilities 
(i.e., the sink rate performance for the landing-flare 
task when the pilot has little depth/height perception 
from the outside scene presentation). The data show 
that there is an incremental increase in touchdown 
sink rate of approximately 3.5 ft/sec that may be ex- 
pected on the ground-based simulator as opposed to 
the real-world environment. 

The results from this study have indicated that 
caution must be exercised in the interpretation of 
simulation results when they may be affected by the 
limitations of the simulator hardware — particularly 
the motion cues and visual cues. 

Introduction 

The primary objective of this study was to de- 
termine the areas of applicability and the fidelity of 
the NASA Langley Visual/Motion Simulator (VMS) 
for predicting the flying qualities of an airplane for 
the approach and landing-flare pilot tasks. The in- 
flight simulation test results from references 1 and 2 
were utilized for comparison with the VMS results. 


The primary goal of the NASA-sponsored flying qual- 
ities experiment reported in reference 1 utilizing 
the USAF-AFWAL Total In-Flight Simulator (TIFS) 
was to generate a consistent set of data to determine 
what a pilot requires to satisfactorily flare and land 
an airplane. In that study, two separate areas of 
analysis were performed on the flying qualities data 
obtained. One area was to determine the pilot’s pref- 
erence in commanded response (e.g., angle of attack 
or pitch rate) and its characteristics. The second area 
was to refine the time-history predictive criterion of 
reference 2. Following the in-flight simulator tests, 
the ground-based simulator study was conducted. 

There are many documents giving comparisons 
of flight and ground-based simulators, but very few 
indicate whether a given simulation of the airplane 
and pilot task of interest can produce a reliable rep- 
resentation of the flying qualities. Because of the 
differences between simulator and airplane and the 
inability to account for all the situations that can 
occur in the real world, the pilot cannot be exposed 
to the “complete tasks” operation of the airplane in a 
simulator. For example, the apprehension, emotional 
stress, and responsibility that a pilot feels in actual 
flight is less, or missing altogether, in the simulator. 
Thus, simulation cannot wholly replace flight tests 
of the airplane concerned, but it may highlight many 
gross “oddities” of the complete pilot- vehicle charac- 
teristics and, therefore, markedly reduce the number 
of flight tests required. 

There is information in the literature on the ad- 
vantages, disadvantages, and practical problems of 
piloted-airplane simulation. For example, reference 3 
discusses the trade-offs between the use of computer 
graphics and closed-circuit television for simulating 
the external scene. Likewise, many reports exist 
giving a detailed discussion of motion cues, how 
they are used by pilots, and how to best utilize the 
capabilities of a specific simulator. (For example, 
see refs. 4 7.) However, there is a lack of infor- 
mation that allows the flight controls/flying quali- 
ties engineer to determine/estimate the incremental 
flying qualities and/or pilot performance differences 
that may be expected between results obtained via 
ground-based simulation and flight tests. To this end, 
pilot opinion and performance parameters derived 
from the six-degree-of-freedom ground-based simu- 
lator (VMS) and the six-degree-of-freedom in-flight 
simulator (TIFS) are compared for a jet-transport 
airplane having conventional cockpit controllers and 
instrument displays with 31 different longitudinal dy- 
namic response characteristics. 

The primary pilot tasks were the approach and 
landing tasks with emphasis on the landing-flare task 



since this is the most demanding task for transport- 
class airplanes. Four engineering test pilots partic- 
ipated in both the ground-based and in-flight sim- 
ulation programs. This paper compares the results 
obtained on these two simulations by the four pilots. 

Symbols and Abbreviations 

Measurements and calculations were made in 
U.S. Customary Units. Dots over symbols denote 
differentiation with respect to time. 


CAP 

control anticipation parameter, 
ul p /(n z /a) 

CHR 

Cooper-Harper rating 

0. 

centerline 

F s 

stick force 

G/S 

glide slope 

9 

acceleration due to gravity 
(lg ~ 32.174 ft/sec 2 ) 

D 

rate of sink at touchdown 

ILS 

instrument landing system 

KIAS 

knots of indicated airspeed 

K qr 

pitch-rate command gain 


angle-of-attack command gain 

L/L 

lead /lag filter in the pilot 
command path 

Mg 

pitching moment due to pitch 
rate 

M n 

pitching moment due to angle 
of attack 

n z 

normal acceleration 

n *P 

normal acceleration measured 
at pilot station 

n z /a 

steady-state normal- 
acceleration change per unit 
change in angle of attack for 
an incremental pitch control- 
surface deflection at constant 
airspeed 

PIO 

pilot- induced oscillation 

9 

pitch rate 

Qc 

pitch-rate command 

s 

Laplace operator 

t 

time 


TIFS 

Total In-Flight Simulator 

VMS 

Visual/Motion Simulator 

a 

angle of attack 

a c 

angle-of-attack command 

6e 

elevator deflection 

7 

rate of change of flight-path 
angle 

7c 

rate of change of flight-path- 
angle command 

Cq 

damping ratio in numerator of 
a/<5 e transfer function 

Cph 

damping ratio of phugoid 
mode 

Csp 

damping ratio of short-period 
mode 

r a 

higher frequency zero in a/6 e 
transfer function 

!/ r 0, 

lower frequency zero in q/6 e 
transfer function 

!/"% 

higher frequency zero in q/b e 
transfer function 

Ld a 

frequency in numerator of 
ot/6 e transfer function 

UJp E 

undamped natural frequency 
of phugoid mode 

u SP 

undamped natural frequency 
of short-period mode 


Description of Simulators 

In-Flight Simulator 

The Total In-Flight Simulator (TIFS), which 
is owned by the U.S. Air Force and operated by 
Calspan, was used as the test vehicle in the “in- 
flight” portion of this study. The TIFS is a highly 
modified C-131 (which is the military counterpart of 
the Convair 580) that has been configured as a six- 
degree-of-freedom simulator (fig. 1). It has a sepa- 
rate evaluation cockpit forward and below the normal 
C-131 cockpit. When flown from the evaluation cock- 
pit in the simulation or fly-by-wire mode, the pilot 
control commands are fed as inputs to the model 
computer, which then calculates the airplane re- 
sponse to be reproduced. These responses, along 
with the TIFS motion sensor signals, are used to 
generate feedforward and response error signals that 
drive the six controllers on the TIFS. (See fig. 2.) The 
result is a high-fidelity reproduction of the motion 
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and visual cues at the pilot position of the model air- 
plane. (More descriptions of the TIFS can be found 
in ref. 8.) Figure 3 presents a typical example of 
the capability of the TIFS to reproduce the model 
response to a time-step pitch-controller input. 

The evaluation cockpit is a dual-pilot, side-by- 
side arrangement and has the capability of provid- 
ing much greater than usual visibility for the pilots. 
By proper masking, the window configuration of any 
particular airplane can be reproduced. The cockpit 
displays, controls, and instruments can be duplicated 
in the extent of detail desired. For the present study, 
no window masking was used and the cockpit dis- 
plays, controls, and instruments were representative 
of those found in transport airplanes at the time of 
this study. Also for this study, the right seat was 
occupied by a NASA flight test engineer. The engi- 
neer observed all approaches and landings, assisted 
in the conduct of the flight test card, recorded es- 
timated touchdown dispersion, and recorded sum- 
maries of pilot comment evaluations and handling 
qualities ratings to provide timely postflight analysis. 
(Note that although the touchdown dispersions were 
“estimated 1 ' by the flight test engineer, the “actual 11 
values were recorded for analysis; e.g., the touch- 
down sink rate was measured via the radar altimeter 
traces.) 

Ground-Based Simulator 

The NASA Langley VMS is a six-degree-of- 
freedom ground-based motion simulator. (See fig. 4.) 
For this study, the simulator had a transport-type 
cockpit equipped with conventional flight and engine 
thrust controls as well as a flight instrument display 
representative of those found in current transport air- 
planes. 

The control forces on the wheel, column, and rud- 
der pedals were provided by a hydraulic system cou- 
pled with an analog computer. The system allows 
for the usual variable-feel characteristics of stiffness, 
damping, coulomb friction, breakout forces, detents, 
and inertia. The limitations in the force-feel char- 
acteristics of the control loader on the VMS were 
such that the dynamics of the force-feel system did 
not exactly match those on the TIFS. However, the 
pilots indicated that these dynamics were matched 
sufficiently so as not to prejudice the results; and, in 
fact, the pilots could not detect the differences. 

The airport scene display used an “out-the- 
window 11 virtual image system of the beam-splitter, 
reflective- mirror type. The system, located nomi- 
nally 4.2 ft from the pilot’s eye, presented a nominal 
48° width by 36° height field of view of a 525-line 
television raster system and provided a 46° by 26° 
instantaneous field of view. The system supplies a 


color picture of unity magnification with a nominal 
resolution on the order of 9 minutes of arc. The scene 
depicted in the virtual image system was obtained 
from a terrain model board. Reference 9 describes 
the state-of-the-art, television-camera transport sys- 
tem used in conjunction with the sophisticated ter- 
rain model board. The maximum speed capability of 
the system is 444 knots with vertical speed capabili- 
ties of ±30000 ft /min. The translational lags of the 
system are 15 msec or less, and the rotational lags 
are 22 msec or less. The average total visual delay, 
including computational throughput delay, was less 
than 70 msec. 

The motion performance limits of the VMS base 
are presented in table I. These limits are for single- 
degree- of- freedom operation. Therefore, conser- 
vatism must be exercised in the use of the position 
limits since these limits change as the orientation of 
the synergistic base varies. References 10, 11, and 
12 document the characteristics of the system which 
possesses time lags of less than 15 msec. The average 
total motion delay, including computational through- 
put, is less than 60 msec and is quite compatible 
with the visual delays. The washout system used to 
present the motion-cue commands to the motion base 
is nonstandard. It was conceived and developed at 
the Langley Research Center and is documented in 
references 7, 13, and 14. 

The only aural cues provided were engine noises 
and landing-gear extension and retraction noises. 


Description of Configurations Evaluated 

The math models were identical on the TIFS and 
VMS, e.g., aerodynamic terms (including ground ef- 
fects) and landing-gear model. A thorough descrip- 
tion of the 31 longitudinal configurations evaluated 
on both the TIFS and VMS simulators is presented in 
reference 1. However, a brief “purpose-of-tests” sum- 
mary of these configurations is presented here and in 
table II. (The configuration numbers used in ref. 1 
have been maintained in this paper.) The config- 
urations flown during the TIFS tests (ref. 1) were 
developed, for the most part, by considering both 
angle- of- at tack and pitch-rate command systems in 
terms of the a/6 e and q/S e transfer functions indi- 
cated below: 




Kg r T nUjl V UJp H (s + T) (<? 2 + 2£gUJ n 8 + ujI) 
ujI (s 2 + 2< SP u;spS + ^|p) (s 2 + 2 Cph^phs + ^p H ) 

(AV^t^Ip^h) «(«+^)( j + ^) 

(a 2 + 2Csp^sps + w sp) ( s2 + 2 Cph w PH« + w ph) 
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Configurations 1-8 

These eight configurations were developed to form 
a basic set to evaluate “command-response” types. 
The first four configurations (1-4) were chosen to 
have a value of l/rg 2 = 0.5, and the low-frequency 
numerator zeros of the ct/6 e transfer function were 
defined to have a frequency uj a of 0.3 rad/sec with 
C« = 0.10. The next four configurations (5-8) were 
designed to have a value of 1 /rg 2 = 0.9, and the 
low-frequency numerator zeros of the a/6 e transfer 
function were defined by u> a =0.1 rad/sec with 
C« =0.10. 

Configurations 9 and 10 

These configurations (being a-command and q- 
command, respectively) were designed to have no 
phugoid residue in either the pitch-rate or angle- 
of-attack responses. That is, the low-frequency 
(phugoid) response is eliminated in both q and a 
by proper zero locations based on configurations 1 
and 2. 

Configurations 11 and 12 

These configurations were defined as flight-path- 
rate (7) command configurations with respect to the 
center of gravity of the airplane, but with the air- 
plane center of rotation located at the pilot location 
(configuration 11) or at the airplane center of gravity 
(configuration 12). Both configurations have two ze- 
ros at the origin in the 7 /F s transfer function; and in 
order to realize a 7 command, two poles at the origin 
were required to cancel the two zeros at the origin. 
(Note that the s 2 = 0 poles dominate the long-term 
response and are very detrimental to flying qualities 
even if the n z (t) response and, in this case, q(t) also 
are smooth and well-behaved in the short term.) 

Configurations 13 and 14 

For these configurations (being a-command and 
(7-command, respectively), a large value of 1/tq (i.e., 
2.0) was selected to equal the value of the short- 
period frequency that resulted in a value of CAP that 
would place the configurations in the level 1 area for 
the category C precision requirement, but in the area 
of the level 1/level 2 boundary with respect to the 
category A precision requirements. (See ref. 15.) 

Configurations 17-20 

The TIFS program in reference 2 briefly investi- 
gated the effects of a washout prefilter on a specific 
pitch-rate command configuration. During the refer- 
ence 1 flying qualities experiment, a systematic inves- 
tigation of the effects of washout was made. Config- 
uration 1-2-2 of reference 2 was chosen as a baseline, 
level 2, pitch-rate command configuration and was 


designated configuration 17 in this program. Then, 
a washout prefilter was added to the pilot command 
path with various washout time constants (configu- 
rations 18 20). These configurations differed from 
configurations 1 14, in that they were mechanized 
with a pitch-rate feedback path and a proportional- 
plus integral compensator in the command path. 

Configuration B 

This was a baseline conventional airplane config- 
uration that was selected to yield level 1 flying qual- 
ities about which time-delay and pitch-sensitivity 
variations could be made to investigate their effects 
on flying qualities for the approach and landing-flare 
piloting tasks. This configuration was based on a 
TIFS (modified C-131) aerodynamic model with in- 
creased M a and M q derivatives in order to achieve 
W SP = 2 rad/sec, £gp = 0.7,1 /tq 2 = 0.75, and 
n z /a = 5.3 g units/rad. The instantaneous center 
of rotation was 22.2 ft aft of the pilot. 

Configurations 21-28 

These were configurations on which time-delay 
and pitch-sensitivity variations were made on a 
level 1 conventional airplane configuration (config- 
uration B described above) to gather data for the 
refinement of the time-domain flying qualities crite- 
rion of reference 2. Three values of time delay and 
three values of pitch sensitivity were evaluated. The 
various pitch-sensitivity values were chosen during 
the calibration test flights in the TIFS. The nomi- 
nal sensitivity was 0.42 ( deg/sec 2 )/lbf. This value 
had been found to be a near-optimum sensitivity for 
wheel/column controllers in previous programs and 
was verified during the calibration flights. Minimum 
and maximum sensitivity values were chosen during 
flight tests that would still yield level 1 or borderline 
level 1 flying qualities. The minimum value chosen 
was 0.25 (deg/sec 2 )/lbf, and the maximum value was 
0.63 (deg/sec 2 )/lbf. These values were selected by 
controlling the “command gain” of the flight control 
system. There are a number of ways to change pitch 
sensitivity, i.e., changing command gain, changing 
short-period frequency, changing short-period damp- 
ing ratio, adding prefilters, etc. It was surmised that 
no matter what method was used to change the sen- 
sitivity, the result would be much the same to the 
pilot. Therefore, the “command gain” method was 
chosen as it tended to better isolate the effects of sen- 
sitivity while keeping other critical factors constant. 
The three levels of sensitivity (command gain) were 
used with each of the three levels of time delay to 
obtain the matrix presented in table III. 
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Configurations 17 4- L/L, 22 A, 25 A, and 28 A 

Additional configurations were added during the 
TIFS evaluation phase of the program to gather time- 
delay /sensitivity data on a pitch-rate command- type 
airplane. The baseline configuration selected for 
this test matrix was configuration 17 with an added 
lead/lag (L/L) filter in the pilot command path. (See 
table III for the time-delay /sensitivity test matrix.) 

The lateral-directional aerodynamics and control 
system utilized in this VMS “longitudinal” study 
were the same as those used in the studies in ref- 
erences 1 and 2 with the TIFS; since they were pre- 
determined to produce level 1 (satisfactory) flying 
qualities, they were “transparent” to the present lon- 
gitudinal flying qualities investigation. 

Test Procedures 

The evaluation pilot was given control of the 
airplane on the downwind leg and performed a visual 
turning approach to a 1.5- to 2-mile final approach. 
The ILS glide slope was intercepted in the turn and 
held to a point 3500 ft from the runway/glide slope 
intercept point. A constant airspeed of 132 knots of 
indicated airspeed (KIAS) was held throughout the 
approach until the flared landing. 

Figure 5 details the final approach and flare ge- 
ometry. A final approach “barrier was defined as 
a barrier projecting up from the ground at a point 
3500 ft short of the runway and glide slope intercept 
point and extending up to the ILS glide path. 1 he 
evaluation pilot was not allowed to descend below the 
ILS glide slope until he had passed the barrier. ^This 
procedure prevented him from “ducking under the 
glide slope and thus making the landing-flare task 
less demanding. During the TIFS evaluations, the 
hypothetical barrier location was well-marked by a 
railroad track. Peer pressure from the safety pilots 
(during the TIFS tests) and the flight test engineer 
was found to be quite sufficient to prevent glide slope 
“duck under/’ 

In addition to the altitude constraint of the bar- 
rier, lateral offsets of approximately 200 ft (either 
left or right) were used to provide a secondary task 
and thus prevent preoccupation with the pitch task. 
Also, in order to further assure pitch-task activity, a 
(1-cosine) angle-of-attack gust was fed to the simu- 
lated airplane model between 100 and 50 ft of alti- 
tude. The evaluation pilot would fly through the gust 
to flare and touchdown. The run was terminated at 
touchdown — the landing rollout was not simulated. 

As indicated in figure 5, the “desired touchdown 
area was defined as being 500 ft long and 20 ft wide 
(±10 ft from runway centerline) beginning 250 ft 


past the runway /glide slope intercept. The “ade- 
quate” touchdown area was defined as being 1000 ft 
long and 40 ft wide (±20 ft) beginning at the same 
point on the runway. The airspeed requirements 
were: “desired” = 132 ± 3 KIAS and “adequate” = 
132 ± 5 KIAS, both at the barrier passage. The “de- 
sired” sink rate at touchdown was defined as 0 to 
3 ft/sec and “adequate” was defined as 3 to 6 ft/sec. 
These values of sink rate at touchdown were ob- 
tained from the data records. However, experience 
has shown that touchdowns of 0 to 3 ft /sec result in 
“smooth” landings, touchdowns of 3 to 6 ft /sec re- 
sult in “solid” landings, and touchdowns in excess of 
6 ft/sec can be recognized by any crew member as 
being “hard” landings. 

The design goal of the above task was to achieve 
sufficient pilot gain in the pitch axis to provide an 
adequate spread in the handling qualities ratings but 
not be so difficult or easy as to bias the pilot ratings. 

The evaluation pilots were briefed on the general 
experiment purpose and flight task details. They 
had a general knowledge of what the test configu- 
rations were in that they had seen descriptions and 
time histories, but they had no knowledge of which 
configurations would be evaluated on any given flight. 
An evaluation normally consisted of two approaches 
and landings. The pilot could make comments at 
any time; however, formal use of the comment card 
(fig. 6), the Cooper-Harper pilot rating scale (fig. 7), 
and the pilot-induced-oscillation (PIO) scale (fig. 8) 
was not made until after the second landing for the 
configuration. It should be noted that the pilot had 
the option of making a third landing for any config- 
uration; and in that case, the comments and evalua- 
tion ratings were not made until after the third land- 
ing. The pilot comments and Cooper- Harper ratings 
were considered the primary data of this investiga- 
tion; however, the touchdown dispersions have also 
been used in the analysis of the results. 

Seven engineering test pilots with a wide variety 
of backgrounds participated in the in-flight (TIFS) 
simulation program. In addition to the NASA 
and Calspan pilots who were scheduled to partic- 
ipate in the NASA-sponsored program, NASA in- 
vited other flight test organizations to provide pi- 
lots if their respective organizations would fund the 
cost for their flights. The Boeing Airplane Com- 
pany, the Lockheed-Georgia Company, and the Ger- 
man Aerospace Research Establishment (DF\ LR) 
accepted this invitation. Four of these pilots (NASA, 
Calspan, Lockheed, and DFVLR) also participated 
in the ground-based simulator (VMS) tests, and this 
paper compares the results obtained on these two 
simulators (TIFS and VMS) by these four pilots. 
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Results and Discussion 

The results of this study are discussed in terms of 
the previously stated objective, i.e., to provide infor- 
mation to the flight controls/flying qualities engineer 
that will assist him in determining the incremental 
Hying qualities and/or pilot performance differences 
that may be expected between results obtained via 
ground-based simulation (particularly by the Lang- 
ley VMS) and flight tests. The primary pilot tasks 
were the approach and landing tasks with emphasis 
on the landing-flare task. The pilot ratings presented 
for the various configurations evaluated are an aver- 
age of the ratings from all pilots who flew that par- 
ticular configuration. 

Flying Qualities 

Figure 9 indicates that for the “approach task” 
the flying qualities Level or ± 1 CHR were predicted 
from the VMS tests for 25 of the 31 configura- 
tions; i.e., 81 percent of the time the pilot opin- 
ion was the same as that for the in-flight simulation 
(TIFS) tests. (It may be noted that 31 configura- 
tions cannot be identified in fig. 9 since some of the 
configurations coincide.) The “±1 Cooper-Harper 
rating (CHR)’ is grouped with the flying qualities 
“level (i.e.. Level or ± 1 CHR ) in order to include 
the shaded triangular areas indicated in the figure. It 
is also shown that the CHR was predicted within ±2 
for 29 of the 31 configurations (94 percent), and the 
CHR was predicted within ±1 for 23 of the 31 con- 
figurations (74 percent). This is considered to be 
good agreement since experience has shown that fre- 
quently two or more pilots flying the same config- 
uration on the same simulator (or flying the same 
airplane) may not evaluate the flying qualities of 
a configuration/airplane any closer than indicated 
here. 

Figure 10 indicates that for the “landing-flare” pi- 
lot task the flying qualities Level or ± 1 CHR were 
predicted from the VMS tests for 25 of the 31 config- 
urations flown; i.e., 81 percent of the time the VMS 
results agreed with the TIFS results. (Note that this 
is the same percentage as for the approach task.) 
Also, the CHR was predicted within ±2 for 27 of 
the 31 configurations (87 percent), and the CHR was 
predicted within ±1 for 18 of the 31 configurations 
(58 percent). 

Upon comparing the data of figures 9 and 10, it 
may be concluded that the accuracy of the flying 
qualities prediction of the Langley VMS for flying 
qualities “level” is approximately 80 percent for both 
the “approach” and “landing-flare” pilot tasks. Also, 
as might be expected, the results show that the 
capability of the ground-based simulator to predict 
Cooper-Harper pilot ratings is somewhat better for 


the “approach” pilot task than for the “landing- flare” 
task. This is probably because for the landing-flare 
pilot task, the pilot tends to be “in the control loop” 
more tightly than for the approach task, and also 
because the “out-the-window” scene (which is less 
realistic on the simulator) is more important to the 
pilot for the landing-flare task. (There is a lack of 
depth perception on the VMS scene.) 

The results discussed henceforth in this paper are 
those obtained during the landing phase (landing- 
flare pilot task) unless specifically noted otherwise. 

The configurations flown during the TIFS tests 
(ref. 1) were developed, for the most part, by consid- 
ering both angle-of-attack and pitch-rate command 
systems in terms of a j 6 e and q/6 e transfer functions. 
Also, the short-period and phugoid modes were con- 
sidered separately because a system can be designed 
in which the angle of attack follows the control com- 
mand in the short term and the pitch rate follows the 
control command in the long term, or vice versa. The 
idea was to try to determine pilot preference both in 
the short term (short-period mode) and in the long 
term (phugoid mode). The time histories presented 
in figure 11(a) indicate the response of a configura- 
tion that has an a c system (both short term and long 
term), and figure 11(b) presents the type of response 
when a q c system (both short term and long term) is 
used. Also, by proper placement of the short-period 
and phugoid poles and zeros, it is possible to obtain 
a short-term a c /long-term q c system, or vice versa. 
(See ref. 1 and the time histories in fig. 12.) 

In an attempt to determine if the type of com- 
mand system (i.e., a c or q c ) had an effect upon the fi- 
delity of the flying qualities evaluations on the Lang- 
ley VMS, the various configurations evaluated were 
grouped as such for analysis. First, all configura- 
tions with an a c system (at least in the short term 
and disregarding the type of command system for the 
long term) were compared from the TIFS and VMS 
evaluations. (See fig. 13.) It should be noted that 
the configurations for which additional time-delay 
and/or pitch-sensitivity variations were made are not 
included in this grouping of a c system configurations. 
(That is, configurations 21 28 were omitted in or- 
der to isolate the effects of various command con- 
trol systems. Configurations 21 28 will be discussed 
later in this paper.) Figure 13(a) indicates that with 
the exception of configuration 1, the flying qualities 
level was correctly predicted on the VMS. The pilots 
downgraded configuration 1 on the VMS primarily 
because of the “unpredictable pitch response” and 
the “tendency to PIO” in the flare. (These adverse 
characteristics were not apparent during the TIFS 
tests.) Figure 13(b) compares the PIO tendency 
classification of the short-term a c configurations and 
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indicates that (1) the tendency for PIO in the flare, 
where the pilot initiates tight control, is much greater 
on the VMS than on the TIFS; and (2) on 30 percent 
of these configurations, the VMS did not correctly 
predict whether the u task would be compromised.” 
(See fig. 8 for the PIO tendency classification scale.) 

Figure 14 compares the pilot opinions from the 
TIFS and VMS for the configurations having an a c 
system (at least in the long term and disregarding the 
type of command system for the short term). (Again, 
configurations 21 28 were not included in this group-* 
ing.) Figure 14(a) indicates that, for the most part, 
the pilot evaluations from the VMS agreed with the 
evaluations from the TIFS insofar as predicting the 
flying qualities level. However, there were substantial 
differences in the CHR’s assigned to these configura- 
tions, and the pilot ratings from the VMS tests were 
always higher (worse). Figure 14(b) presents the PIO 
classification results for the long-term a c configura- 
tions and indicates that, in general, the tendency to 
PIO on the VMS was greater than on the TIFS. 

A comparison of the pilot opinions on the TIFS 
and VMS tests for the pitch-rate command (q c ) con- 
figurations is presented in figure 15 for short-term q c 
systems and in figure 16 for long-term q c systems. 
The agreement in the flying qualities evaluations be- 
tween the ground-based simulator (VMS) and the in- 
flight simulator (TIFS), in regard to the flying qual- 
ities level, was excellent regardless of whether the 
q c system was short term, long term, or both. Also, 
note that the CHR’s from the two simulations were in 
good agreement (ACHR < 2) for the configurations 
simulated having pitch-rate command systems. In 
addition, figures 15(b) and 16(b) indicate that there 
was very good agreement between the two simulators 
for the PIO tendency classification. Furthermore, all 
q c configurations (except configuration 14) were cat- 
egorized as not being PIO prone; i.e., the task per- 
formance was not compromised (a PIO rating less 
than 2.5). The pilot complained about the overly 
sensitive pitch-response characteristics of configura- 
tion 14, which has a very high 1 /r^ 2 , during both 
simulator tests- and this “problem” was more pro- 
nounced on the VMS. Note that for configuration 14, 
the task performance was compromised on the VMS 
(a PIO rating of 4) and was borderline to being com- 
promised on the TIFS (a PIO rating of 2). 

From the results presented in figures 13 16, the 
following conclusions are given: 

1. For the configurations having an a c system 
(short term and/or long term), the tendency 
for PIO, where the pilot initiates tight control, 
was often much greater on the ground-based 


simulator than on the in-flight simulator 
probably because of the lack of sufficient visual 
cues on the VMS. 

2. For the configurations having a q c system 
(short term and/or long term), the agreement 
between the two simulators was excellent in 
regard to the flying qualities level; the CHR s 
were in good agreement (ACHR < 2 for all 
configurations); the PIO tendency classifica- 
tion was in very good agreement between the 
two simulators; and, in general, these q c con- 
figurations were less PIO prone than the a c 
configurations on both simulators. 

As stated previously, configurations 21 28 were 
configurations for which time-delay and command 
gain (sensitivity) variations were made on a baseline, 
level 1, conventional airplane configuration (config- 
uration B described earlier). The test matrix for 
the time-delay/sensitivity configurations is presented 
in table III. It should be noted that the baseline 
“effective” time delay was approximately 150 and 
187 msec for the TIFS and VMS evaluations, respec- 
tively. (Additional time delay was added to these 
“inherent” delays as pure transport delay.) 

Figure 17 compares the pilot opinions (CHR s) 
obtained for the time-delay/sensitivity test configu- 
rations on the TIFS and VMS. Figure 17(a) indicates 
excellent agreement between the two simulators when 
the low sensitivity was used; both sets of data indi- 
cated that for the landing-flare pilot task, the max- 
imum effective time delay would be approximately 
240 msec for satisfactory flying qualities (CHR 

< 3.5). Figures 17(b) and 17(c) indicate the differ- 
ences in pilot opinion obtained on the TIFS and VMS 
as the effective time delay was increased for nominal 
(fig. 17(b)) and high (fig. 17(c)) control sensitivity. 
The pilot ratings between the TIFS and VMS were 
considerably different for both the nominal and the 
high values of sensitivity. For the nominal sensitiv- 
ity configurations (fig. 17(b)), the results show that 
the maximum effective time delay for level 1 (CHR 

< 3.5) flying qualities was approximately 185 msec 
on the TIFS compared with approximately 315 msec 
on the VMS. It is also indicated that a maximum 
time delay for level 2 (CHR < 6.5) flying quali- 
ties was 315 msec on the TIFS, compared with a 
time delay of something much greater than 400 msec 
on the VMS. Figure 17(c) also shows large differ- 
ences between the CHR’s obtained on the TIFS and 
VMS when high control sensitivity was evaluated. It 
should also be noted that for the high-sensitivity con- 
figurations, none were rated as being level 1 on the 
VMS— even with no “additional” time delay. 
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From the results presented in figure 17, the fol- 
lowing conclusions are given: 

1. The effect of control sensitivity is more pro- 
nounced on the ground-based simulator, par- 
ticularly at the lower control-system time 
delays. 

2. In general, the pilot is more tolerant of control- 
system time delays on the ground-based sim- 
ulator. 

Figure 18 indicates the differences in PIO ten- 
dency between the TIFS and the VMS for the con- 
figurations with no added time delay. It is evident 
from these data that the pilot has a greater tendency 
to induce oscillations on the ground-based simulator 
than when flying the in-flight simulator. However, 
figure 19 indicates that for configurations having high 
time delays (table III), the pilot is less prone to in- 
duce oscillations on the ground-based simulator than 
on the in-flight simulator. 

Landing Performance 

As stated previously, the landing performance was 
evaluated during the TIFS and VMS tests by record- 
ing the touchdown sink rate as well as the longitu- 
dinal and lateral touchdown dispersions on the run- 
way. Figure 20 compares these landing-performance 
parameters between the two simulators. These data 
indicate that the touchdown sink rate on the VMS 
was much higher than on the TIFS. The “desired” 
sink rate (h X D < 3 ft /sec) was accomplished for 
less than 15 percent of the VMS landings compared 
with approximately 90 percent of the landings on the 
TIFS. Note also that /jtd was unacceptable (greater 
than 6 ft /sec) for more than 15 percent of the 
landings on the VMS. This inability to accom- 
plish a good touchdown sink rate on the ground- 
based simulator was not surprising since the pilot 
has little depth/height perception from the 
outside scene presentation. Although not presented 
in figure 20. the average touchdown sink rate was 
1.7 and 5.1 ft/sec on the TIFS and the VMS, re- 
spectively. This suggests that there is a A h XD 
value of approximately 3.5 ft/sec that may be ex- 
pected from the ground-based simulator as op- 
posed to the real-world environment. This expec- 
tation is in agreement with previous studies (for 
example, refs. 16 and 17) which have shown ground- 
based-simulator touchdown sink rates to be 2.5 to 
3.0 times greater than those experienced during flight 
tests. 

As seen in figure 20, the differences in the longitu- 
dinal and lateral touchdown dispersions between the 
TIFS and VMS were much less than the differences 


in touchdown sink rates. Figure 20 also presents 
the “overall” touchdown performance difference be- 
tween the TIFS and the VMS. (The term “overall” 
indicates that the sink rate, lateral-runway position, 
and longitudinal-runway position are all satisfied for 
any given category of acceptance.) It may be noted 
from this “overall” performance histogram that “de- 
sired” performance was achieved on the VMS less 
than 5 percent of the time primarily due to the sink 
rate performance. 

Concluding Remarks 

Pilot opinion and performance derived from a 
six-degree-of-freedom ground-based simulator (the 
Langley Visual/Motion Simulator (VMS)) and a 
six-degree-of-freedom in-flight simulator (the USAF- 
AFWAL Total In-Flight Simulator (TIFS)) are 
compared for a jet- transport airplane having con- 
ventional cockpit controllers and instrument displays 
with 31 different longitudinal dynamic response char- 
acteristics. The primary pilot tasks were the ap- 
proach and landing tasks with emphasis on the 
landing-flare task. This paper summarizes the re- 
sults from this “comparative” study. 

The accuracy of the flying qualities predic- 
tion of the Langley VMS for flying qualities 
Level or ± 1 CHR was approximately 80 percent for 
both the approach and the landing-flare pilot tasks. 

As expected, the capability of the ground-based 
simulator to predict Cooper-Harper ratings (CHR's) 
was somewhat better for the approach pilot task than 
for the landing-flare task. For the approach task, 
the CHR was predicted within =fcl for approximately 
75 percent of the configurations evaluated compared 
with less than 60 percent of the configurations for the 
landing-flare task. 

For the configurations having an angle-of-attack 
command system, the tendency for pilot-induced os- 
cillations (PIO’s), where the pilot initiates tight con- 
trol, was much greater on the ground-based simulator 
than on the in-flight simulator probably because of 
the lack of sufficient visual cues on the ground-based 
simulator. For the configurations having a pitch-rate 
command system, the PIO tendency classification 
was in good agreement between the two simulators. 
In general, the pitch-rate command ( q c ) configura- 
tions were less PIO prone (the task was not compro- 
mised) than the angle-of-attack (a c ) configurations 
on the ground-based simulator. Therefore, the defi- 
ciencies of the ground-based simulator (primarily the 
visual cues) may not be as detrimental for the q c con- 
figurations as for the a c configurations. 

The effect of pitch-control sensitivity was more 
pronounced on the ground-based simulator than on 
the in-flight simulator, particularly at the lower 
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control-system time delays. In general, the ground- 
based simulator showed less sensitivity to time de- 
lays in the airplane response than did the in-flight 
simulator. 

The data show that there is an incremental 
increase of touchdown sink rate of approximately 
3.5 ft/sec that may be expected on the ground-based 
simulator as opposed to the real-world environment. 
The ground-based simulator was not adequate for as- 
sessing sink rate performance for the landing-flare 
task when the pilot has little depth/height percep- 
tion from the outside scene presentation. 

It is concluded that, in general, flying qualities 
results obtained from the ground-based simulator 
may be considered conservative — especially when the 
pilot task requires tight pilot control. That is, in 
general, the Cooper-Harper ratings (CHR’s) and the 
pilot-induced-oscillation (PIO) classification ratings 
were higher (worse) on the ground-based simulator. 
The one exception to this, according to the present 
study, was that the pilots were more tolerant of large 
time delays in the airplane response on the ground- 
based simulator. 

The results from this study have indicated that 
caution must be exercised in the interpretation of 
simulation results when they may be affected by the 
limitations of the simulator hardware — particularly 
the visual cues. 

NASA Langley Research Center 
Hampton, VA 23665-5225 
September 28, 1989 
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Table I. Motion Performance Limits of the Langley Visual/Motion Simulator (VMS) 


Degree-of- freedom 
operation 

Position 

Velocity 

Acceleration 

Pitch 

+30°, -20° 

±15 deg/sec 

±50 deg/sec 2 

Roll 

±22° 

±15 deg/sec 

±50 deg/sec 2 

Yaw 

±32° 

±15 deg/sec 

±50 deg/sec 2 

Vertical 

+2.50 ft, -3.25 ft 

±2 ft /sec 

±0.6 g units 

Lateral 

±4.0 ft 

±2 ft/sec 

±0.6 g units 

Longitudinal 

+4.1 ft, -4.0 ft 

±2 ft/sec 

±0.6 g units 


Table II. Summary of Configuration Characteristics 


Configuration 

(a) 

Command response type 

W SP> 

rad/sec 

Csp 

t4, PH> 

rad/sec 

(b) 

Cph 

(b) 

1/^2’ 
rad / sec 

n 2 /a, 

g units/rad 

B 

Conventional airplane 

2 

0.7 

0.16 

0.095 

0.75 

C 5 3 

1 

a c (short term and long term) 

2 

.7 

.3 

.1 

.5 

3 5 

2 

q c (short term and long term) 

2 

2.1 

(-) 

(-) 

.5 

3 5 

3 

a c (short term)/g c (long term) 

2 

.7 

(-) 

(-) 

.5 

3 5 

4 

q c (short term)/a c (long term) 

2 

1.3 

.3 

.1 

.5 

3.5 

5 


2 

.7 

.1 

.1 

.9 

6.3 

6 

Qc 

2 

1.3 

(-) 

(-) 

.9 

6.3 

7 

Oichc 

2 

.7 

(-) 

(-) 

.9 

6.3 

8 

A 

(]c/a c 

2 

1.3 

.1 

.1 

.9 

6.3 

9 

1 A 

a c 

2 

.7 

(-) 

(-) 

.5 

3.5 

10 

Qc 

2 

1.3 

(-) 

(-) 

.5 

3.5 

11 
1 o 

7c 

2 

.7 

(-) 

(-) 

.5 

3.5 

Iz 

7c 

2 

.7 

(-) 

(-) 

.5 

3.5 

13 

Ot C 

2 

.7 

.3 

.1 

2.0 

14.0 

14 

Qc 

2 

1.3 

(-) 

(-) 

2.0 

14.0 

17 20 

Qc 

2.9 

.78 

(-) 

(-) 

.72 

5.0 

21-28 

Conventional airplane 

2 

.7 

.16 

.095 

.75 

5.3 

17 + L/L 

Qc 

2.9 

.78 

(-) 

(-) 

.72 

5 0 

22A, 25 A, 28A 

Qc 

2.9 

.78 

(-) . 

(-) . 

.72 

5.0 


“Configuration numbers correspond with those in reference 1. 
Configurations with phugoid characteristics listed as (-) have real roots. 
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Table III. Time-Delay /Sensitivity Test Matrix 


Configuration 

(a) 

Flight control 
system 

Sensitivity 

Time delay, msec 

JJM 

(b) 

Command gain, 
deg/in. 

TIFS 

VMS 

B 

B 

0.42 (nominal) 

—3.3 (nominal) 

150 

187 

21 

B 

.42 (nominal) 

—3.3 (nominal) 

250 

281 

22 

B 

.42 (nominal) 

—3.3 (nominal) 

350 

375 

23 

B 

.25 (low) 

-2.0 (low) 

150 

187 

24 

B 

.25 (low) 

-2.0 (low) 

250 

281 

25 

B 

.25 (low) 

-2.0 (low) 

350 

375 

26 

B 

.63 (high) 

-5.0 (high) 

150 

187 

27 

B 

.63 (high) 

-5.0 (high) 

250 

281 

28 

B 

.63 (high) 

-5.0 (high) 

350 

375 

17 + L/L 

17 + L/L 

.42 (nominal) 

—.74 (nominal) 

150 

187 

22k 

17 + L/L 

.42 (nominal) 

—.74 (nominal) 

350 

375 

25A 

17 + L/L 

.25 (low) 

—.44 (low) 

350 

375 

28A 

17 + L/L 

.63 (high) 

-1.11 (high) 

350 

375 


“Configuration numbers correspond with those in reference 1. 
fc Pitch acceleration per column force, (deg/sec 2 )/lb. 



L-89-123 


(a) Photograph of the TIFS. 



(b) Schematic of the TIFS. 


Figure 1. The USAF-AFWAL Total In-Flight Simulator (TIFS) used in the in-flight study. 


ORIGINAL PAGE 

Pi ACK AND WHITE PHOrnoPAPM 






13 






TIFS response 



Figure 3. Example of TIFS capability to reproduce the model response to a time-step pitch-controller input 
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Figure 4. The Langley Visual/Motion Simulator (VMS). 
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Figure 5. Indication of approach and landing task. 
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Initial Overall Impression 


Approach 

1. Initial/Final response to control inputs 

2. Flight- path control 

3. Pitch-attitude control 

4. Airspeed control 

5. Offset correction 

6. Atmospheric disturbances 

7. Special pilot techniques 

Flare and Touchdown 

1. Pitch-attitude and flight- path control 

2. Control of touchdown parameters 

3. Atmospheric disturbances 

4. Special pilot techniques 

Pilot Ratings 

1. Approaches 

2. Flare and touchdown 

3. Overall 

4. PIO rating 


Figure 6. Pilot comment card. 
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4 , . . # Definition of required operation involves designation of flight phase and/or 

Pilot decisions subphases with accompanying conditions. 













Level or ±1 CHR 





Level or ±1 CHR 



Cooper-Harper rating on TIFS 

Figure 10. Comparison of pilot opinions of flying qualities obtained on the TIFS and VMS for the landing-flare 
task for all configurations. 









Cooper-Harper 
pilot rating 



B 1 35 7 9 13 

Configuration 


(a) Cooper-Harper pilot ratings. 


PIO rating 



B 1 357 913 

Configuration 


(b) PlO-tendency classification. 


Figure 13. Comparison of pilot opinions from the TIFS and VMS for configurations with short-term a c system 
for landing-flare pilot task. 
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(a) Cooper-Harper pilot ratings. 


6 

5 

Divergent 

- oscillations 

occur 

7///////////////////////////////JC/////////////////Z. 

4 

PIO rating 

3 

1 

f 

Task 

performance 

compromised 


/////////////////A 

'//////A/////////////////////////, 

2 

1 

— DO 1 

1 1 1 1 l 

Task 

p p performance 

T T not 

30 ° compromised 

1 1 1 1 1 1 1 1 


B 1 4 5 8 13 

Configuration 

(b) PIQ-tendency classification. 
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Figure 14. Comparison of pilot opinions from the TIFS and VMS for configurations with long-term a. svstem 
for landing-flare pilot task. 
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pilot rating 



Configuration 


(a) Cooper-Harper pilot ratings. 


P 10 rating 



2 4 6 8 1 0 14 17 10 19 20 

Configuration 


(b) PlO-tendency classification. 


Figure 15. Comparison of pilot opinions from the TIFS and VMS for configurations with short-term q c system 
for landing-flare pilot task. 
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(a) Cooper-Harper pilot ratings. 
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2 
1 
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Configuration 

(b) PlO-tendency classification. 

Figure 16. Comparison of pilot opinions from the TIFS and VMS for configurations with long-term q c system 
for landing-flare pilot task. 
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Cooper-Harper 
pilot rating 



□ TIFS 
0 VMS 


(a) Low sensitivity. 


Coo per- Harper 
pilot rating 



□ TIFS 
o VMS 


(b) Nominal sensitivity. 

Figure 17. Comparison of pilot opinions from the TIFS and VMS for evaluating effects of time delay and 
control sensitivity for landing-flare pilot task. 
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Figure 18. Comparison of PlO-tendency classification between the TIFS and VMS with nominal control 
sensitivity and no additional time delay. The solid line indicates perfect agreement. 
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Figure 19. Comparison of PlO-tendency classification between the TIFS and VMS with nominal control 
sensitivity and variations in control-system time delays. 
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(c) Longitudinal position at touchdown. (d) Overall performance at touchdown 

Figure 20. Landing-performance differences between the TIFS and VMS. 






















